AMD has introduced its AI chip Instinct MI325X and MI355X. These models, which promise significant improvements in memory capacity and performance compared to the currently used MI300X, also include AMD in the AI field.
AMD Instinct MI325X and MI355X introduced
Instinct MI325X, which will enter the testing phase with business partners in the last quarter of 2024; is based on AMD’s 3nm CDNA 3 architecture. Accordingly, it includes 256GB of high-bandwidth memory (HBM3e), a first for an AI chip. This large memory allows programmers and researchers to work with AI models and datasets on a single accelerator.
AMD claims that MI325X offers up to 40 percent better performance than its rival Nvidia H200 in certain AI workloads. An 8-way server built with MI325X is up to 40 percent faster in AI training compared to the H200 system.
AMD also introduced the MI355X GPU chip, which is planned to be released in 2025. Manufactured with an even more advanced 3nm process, the MI355X will use AMD’s CDNA 4 architecture. Accordingly, it will support the new FP4/FP6 digital formats for AI. The most exciting feature is the 288GB HBM3e memory, an industry first.
AMD claimed that the CDNA 4 architecture provides up to 7 times more AI performance compared to CDNA 3. In an 8-way system, the MI355X; It promises a huge leap in capability compared to existing solutions.
{{user}} {{datetime}}
{{text}}